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Abstract: 

This study explores the deployment of electronic portfolios to a university-wide cohort of freshman 
undergraduates that included a subgroup of at-risk and lower academically prepared learners. Five evaluative 
dimensions based on persistence and engagement theory were included in the development of four assessment 
rubrics exploring goal clarity, support from friends and family, academic engagement, social integration, and quality 
of effort were used to assess student ePortfolios. Data collected from these five were integrated with institutional 
measures producing two structural equation models explaining undergraduate persistence for students returning 
with 2.5 and 3.2 GPAs with an explained variance of 31 and 39 percent respectively. Carefully designed 
interventions geared to assist students in continuing their studies as second year undergraduates are considered. 
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First Year Student Adjustment, Success, and Retention: Structural Models of Student Persistence Using 

Electronic Portfolios 



Introduction, Purpose and Objectives: 

As an emerging paradigm in higher education, digitized student portfolios (Yancey 2001; 2008) and computer 
learning environments (Azevedo 2005) have received considerable attention regarding their purported effects on 
teaching and learning (Carr, Skeele, and Middleton, 2007). This study examines the deployment of electronic 
portfolios to a university-wide cohort of freshman undergraduates that included a subgroup of at-risk and lower 
academically prepared learners. 

As an academic unit, Freshman Studies provides a programmatic co-curriculum designed to assist students in 
meeting key personal, academic and professional/career goals with an aim to helping them become engaged as 
successful learners in college (Wolf-Wendel, Ward, and Kinzie, 2009). In an aligned manner, the co-curriculum 
intended to increase the effective use of technology using electronic portfolios (ePortfolios) through a mobile 
computing initiative (Landry and Stewart, 2005). The institution infused Freshman Studies core initiatives with 
ePorftfolios to deepen reflective thinking practice, effort, and student achievement goal orientations (Phan 
2009a; 2009b) thereby promoting the success of college students (Chickering and Kuh, 2005) and student learning 
effectiveness using technology (Landry and Stewart, 2005). 

As an assessment measurement device, electronic portfolios have been shown to "determine individual students' 
mastery of learning and support feedback for improvement" for the individual and institution alike (Knight, Hakel, 
and Gromko, 2008). For the student, well structured freshman ePortfolios provide a "place" to reflect on 
University experiences , adjust to academic and student life, and explore career aspirations, while for the 
University, ePortfolios supply an ample source of information to stem attrition (Sandler, Easterling, and Zedeck, 
2008). Using 2006 freshman electronic portfolios, evaluative rubrics were developed to assess first year student 
experience supplying non-cognitive data as a means to address the research questions of the project. 

Research Questions: 

• What learning is taking place as a function of digital portfolios? How do we know? 

• Can ePortfolios serve as a source of information concerning first year student experience? 

• What can be learned from a systematic review of freshman ePortfolios? 

• What learning is taking place as a function of digital portfolios? 

• Will rubrics based on persistence theory produce meaningful data? 

• Will ePortfolio data increase our ability to predict student persistence from first to second year? 

(Wankel, Gottlieb, and Easterling, 2008; Sandler 2008) 
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Freshman Studies, University Life, Teaching, Learning and Technology Center and a Presidential Initiative: 



Over a period of several years the curriculum of the University Life course for Freshman Studies evolved whereby in 
the fall of 2006 ePortfolio technology was in place to deploy a University Life coordinated curriculum for all 
freshmen electronically. The persistence/retention literature was deemed by the team of developers to provide the 
appropriate building blocks for a conceptual framework as clear links were associated with the goals and objectives 
of the University Life curriculum. Consultations with the University Registrar and Enrollment Management about an 
enhanced attrition warning system emerged out of a Presidential initiative that was communicated to the University 
community. The five rubrics developed for this study evolved from the "Pillars of Retention" presidential initiative 
(Appendix A) (Sandler, Easterling, and Zedeck, 2008; Sandler 2008). 

After careful consultation with the Dean, Associate Dean and senior mentors of the Freshman Studies program and 
the Teaching Learning and Technology Center, the conceptual framework based on persistence theory was agreed 
upon for University Life assessment using ePortfolios. Interest in the career development in consultation with The 
Career Center emerged as academic and career goals became a central developing theme for the co-curriculum, 
reflected in the fall 2006 ePortfolio assignment (Appendix A) pertaining to the University Life curriculum. 

At around this same point in time the University joined the third Cohort of the (l/NCEPR) International/National 
Coalition for Electronic Portfolio Research. This coalition brings together faculty from approximately ten campuses in 
successive cohorts. In a cohort, these ten institutions each design a campus-based research agenda, receive 
consultative feedback from the leadership of the coalition and professional workshops, and share peer feedback on 
portfolio learning goals and objectives. In turn each institution enacts their respective research agenda and 
timelines and participates in cohort/member presentations to ultimately report on their ePortfolio program 
initiatives, outcomes, and results over a two year period (Sandler, Easterling, and Zedeck, 2008; Sandler 2008). 

Theoretical and Conceptual Frameworks: 

Computer-based learning environments have become ubiquitous (Green, 1996) as students use them extensively in 
and out of the classroom in conceptually rich domains, involving a set of "complex interactions between cognitive, 
motivational, affective, and social processes" (Azevedo 2005). These complex interactions are integrally related to 
student adjustment (Chartrand 1992; Bean and Vesper, 1990), learning (Chickering and Gamson 1987; 1989), and 
persistence in college (Tinto 1993; Pascarella and Terenzini, 1991, 2005; Cabrera, Nora, and Castaneda, 1993; Kuh, 
2001; Kuh, Kinzie, Schuh, Whitt, et als., 2005; Sandler 2000). Concurrently with an overlapping timeline, digitized 
student portfolios (Yancey 2001; 2008) have received considerable attention regarding their purported effects on 
teaching and learning (Carr, Skeele, and Middleton, 2007) and student persistence (Sandler, Easterling, and 
Zedeck, 2008; Sandler 2008). 

Accordingly, as a means to evaluate freshman ePortfolios, student adjustment, and persistence, a team of 
researchers crafted four assessment rubrics that were derived from the persistence/retention literature (Tinto 
1993; Cabrera, Nora, and Castaneda, 1993; Sandler, 2000). Each rubric was comprised of a four point scale that 
yielded eight (8) scores, from which five (5) evaluative dimensions/variables were prepared for quantitative analysis 
using structural equation modeling and path analysis (Sandler, Easterling, and Zedeck, 2008; Sandler 2008). 
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Five Evaluative Dimensions Based on Persistence Theory were Included Using Four Rubrics: 

The integrated model of student persistence of Sandler (2000), the notions of goal commitment (Tinto 1993), 
academic and social of integration (Pascarella and Terenzini, 1991; 2005), academic engagement (Kuh 2001; Kuh, 
Kinzie, Schuh, Whitt, et als., 2005) and quality of student effort (Chickering and Gamson, 1999; Phan 2009a) were 
considered the principal theoretical components of the conceptual framework employed (Sandler, Easterling, and 
Zedeck, 2008). Five evaluative dimensions based on persistence and engagement theory were included in the 
development of four rubrics with antecedent reference made to the literature: 

• Goal Clarity, academic and career goals (Tinto 1993; Sandler 2000) 

• Perceived Support from Friends and Family (Cabrera, Nora, and Castaneda, 1993; Sandler 2000; Friedlander, 
Reid, Shupak, and Cribbie, 2007) 

• Academic Engagement (Pascarella and Terenzini, 1991, 2005; Tinto, 1993; Sandler 2000; Kuh 2001; Kuh, 
Kinzie, Schuh, Whitt, et als., 2005; Wolf-Wendel, Ward, and Kinzie, 2009). 

• Social Integration (Pascarella and Terenzini, 1991; 2005; Tinto 1993; Sandler 2000) 

• Quality of Effort (Chickering and Gamson, 1999; Phan 2009a). 

Methodology, Survey Administration, Population and Sample: 

In order to elicit reflection and obtain student data for evaluation, an electronic portfolio assignment was 
developed for all University freshmen (1200 students) by a Freshman Studies Program. The assignment was 
administered by twenty-five (25) University mentors/lead instructors to fifty-five (55) sections of a University Life 
course (bearing one credit) taught with a uniform co-curricular syllabus at a private Catholic University in the 
northeast of the United States during the fall 2006 semester. By matching the total freshman student 
demographic and academic profile at the institution, a sample was determined to be representative of the 
Freshman population consisting of most University Schools, undergraduate divisions and departments, N=384. 

Evaluator/mentor scores were derived as measures of student experience and were inferred from co-curricular 
exercises using electronic portfolios demonstrating evidence of 1) academic and career goals, and 2) student life 
and related activities. The initial crafting of the four assessment rubrics: 1) Goal Clarity, 2) Support from Friends 
and Family, 3) Academic Engagement & Social Integration, and 4) Quality of Effort was conducted by a research 
team of three. Two lead mentors provided further refinements of the rubrics in consultation with team 
developers before a formal evaluation was conducted by sixteen (16) mentors in two six hour scoring sessions. 

Forty ePortfolios were scored twice by different mentors to determine scoring concordance during a pre- 
evaluation/testing phase by comparing the mean rubric scores and reliability coefficients of 40 electronic 
portfolios that served as the evidentiary content. The portfolios were structured around a term assignment while 
a template enabled students to build their electronic portfolios in fall 2006 with elements prescribed in the 
assignment and university life syllabus (Appendix A). 
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After refinements were finalized at the conclusion of the pre-evaluation/testing phase, a cursory review of the 
means and reliability coefficients of the rubric scores provided a green light to proceed with two formal 
evaluation sessions. The same procedure was followed during the formal evaluation sessions when 
approximately 400 ePortfolios were evaluated in two six hour sessions in January 2008 and April 2008. The 
evaluations from the two sessions were merged upon which inter-rater reliability was confirmed. 

Once the mean scores and reliability of the two independent evaluations of each ePortfolio were found to be in 
concordance, approximately 400 total ePortfolio evaluations were randomly selected from the two sets of each 
mentors' evaluations so that a single comprehensive set of the selected ePortfoios would be available for 
quantitative analysis. The total ePortfolios scored after listwise deletion, N = 366. Five dimensions of inquiry 
explored in the four rubrics comprised five endogenous variables in the study. Persistence/Return to study Fall 2 
with a 2.5 Cumulative GPA and 3.2 Cumulative GPA (Fall 2007), a sixth, was added from institutional data. 

Data Sources, Variables, Reliability, and Findings: 

Twelve variables were included for analysis including six (6) endogenous variables described above. Six (6) 
exogenous variables were also included from institutional data to determine and control for student background. 

Six Endogenous Variables: 

Goal Clarity 

Support from Friends and Family 
Academic Engagement & Social Integration 
Quality of Effort 
Persistence, Returned Fall 2 

Six Exogenous Variables: 

Gender 

Race/Ethnicity, Minority/Majority White (dichotomous) 

NJ Resident (dichotomous) 

SAT Math & Verbal Combined Score 
HS GPA 

Campus Resident/Computing Time 
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Data Analysis: 



The sample included N = 384 rubrics scores collected from evaluations of freshman electronic portfolio content. 
Rubrics scored after listwise deletion, N = 366. 

Preliminary descriptive, correlation and reliability analysis of the rubrics scores was conducted using SPSS 16. A 
demographic profile of the sample N=366 was determined to be representative of the freshman population of 
1200 students during the fall 2006 semester. Preliminary analysis included four profiles; elements of the four 
profiles listed below can be found in Appendix A (Sandler, Easterling, and Zedeck, 2008; Sandler 2008): 

- Student Profiles Persistence Profiles 

- Rubric Score Profiles Correlation Matrix. 



Reliability Analysis: 

The utility of the use of the evaluative rubric data as a combined scale was considered as a possible direction for 
the research, but was deemed unnecessary and tangential to the structural analysis that followed. The actual 
scores from the evaluative rubrics for Goal Clarity, Support from Friends and Family, Academic Engagement, and 
Social Integration were employed as variables in the structural path model that followed. 

• Four combined rubric scores (4 scores - Goal Clarity, Support from Friends and Family, Social Integration, 
Academic Engagement) Cronbach alpha reliability = .691, N=366. 

After a Cronbach alpha reliability score was computed, the four scores that comprised the Quality of Effort variable 
were reduced using a principal components analysis to one orthogonal factor; varimax rotation produced one non- 
rated orthogonal factor. In turn, the Quality of Effort variable was included in the structural path analysis that 
followed as a single factor score. 

• Quality of Effort (4 scores -fulfillment of assignment, organization, mechanics, readability/aesthetic) - 
Cronbach alpha reliability = .857, N=366. 

Two Path Analytic Structural Equation Models: 

With rubric and institutional data in a complete dataset, two path/analytic structural equation models were 
determined from the measurement models to explain students returning with a 2.5 and 3.2 Cumulative GPAs. 

As a means to appropriately address the variable types that included ordinal, continuous and dichotomous 
measures, and to examine the non-recursive effects among variables and bi-directional effects between variables, 
structural equation modeling was conducted using LISREL 8.80 with a WLS estimator after a pretreatment phase 
using PRELIS 2.5 (Joreskog and Sorbom, 1993). 
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Results: 



The explained variance for Perceived Support (R 2 2.5=.150, R 2 3.2=.125), Social Integration (R 2 2.5=.235, R 2 
3.2=225), Academic Engagement (R 2 2.5= 097, R 2 3.2=.091), Goal Clarity (R 2 2.5= 106, R 2 3.2=.083), and Quality of 
Effort (R 2 2.5=.202, R 2 3.2=.194), Persistence (R 2 2.5=.314, R 2 3.2=.394), for the two models explaining persistence 
with 2.5 and 3.2 GPAs respectively were respectable at low to moderate levels using evaluative data from student 
ePortfolios. These findings are indeed new to higher education particularly using advanced techniques like 
structural equation modeling where the non-recursive (bidirectional) path relationships among the variables were 
determined. 

Describing the total effects of all six endogenous variables is beyond the scope of this paper, but the reader can 
trace these effects fairly well using Figures 1 and 2. The results presented will focus on the total effects on 
Persistence for students returning in Fall 2 with a 2.5 Cumulative GPA and 3.2 Cumulative GPA. The total effects 
on Persistence are primarily composed of direct effects as indicated in Tables 1 and 2 with the exception of the 
total effects of Goal Clarity which are largely composed of indirect effects in both models explaining persistence, 
meaning the total effects are mediated through an intervening variable(s). Nevertheless, due to the complexity of 
the bidirectional effects in both models, trying to determine the source or path of the indirect effects with regard 
to Goal Clarity can be very difficult to deconstruct. For the sake of making the data accessible, the tables 
presented use more informal reporting labels, providing parsimony in an informal manner, suggesting the "effects 
are mostly" direct or indirect in composition when reporting the total effects on Persistence. 

Insert Figures 1 and 2. 



Total Effects on Persistence: 

As the standardized total effects indicate, for every unit increase of student persistence with a Cumulative GPA of 
2.5, the following four variables served as predictors at low to moderate levels: Goal Clarity .135 (p < .001), 
Quality of Effort .235 (p < .001), Total SAT Math & Verbal combined .261 (p < .001), and HSGPA .356 (p < .001) 
producing an explained variance of .314 (Table 1). 



Table 1: Model One Explaining Persistence with a Cumulative GPA of 2.5 



1 R 2 CumGPA 2.5 
N=366 



Primary Significant Total Effects on R 2 
Return - Persistence Total Effects 
Reduced R Square = 0.314 



Effects are mostly 



6 


Endogenous 


Goal Clarity 


0.135 


* * * 


Indirect 






Quality of Effort 


0.235 


* * * 


Direct 


6 


Exogenous 


TSATMV 


0.261 


* * * 


Direct 






HSGPA 


0.356 


* * * 


Direct 



*p < .01 **p < ,005 ***p < .001 



Goodness of Fit: Chi-Square with 48 degrees of freedom = 35.398 (jd = .912). 
Goodness of Fit Index (GFI) = 0.994, Adjusted Goodness of Fit Index (AGFI) = 0.990. 
Root Mean Square Residual (RMR) = 0.0387 (Joreskog and Sorbom, 1993 ). 
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Similarly for every unit increase of student persistence with a Cumulative GPA of 3.2, the following four variables 
served as predictors at low to moderate levels: Goal Clarity .084 (p < .01), Quality of Effort 0.111 (p < .005), Total 
SAT Math & Verbal combined .296 (p < .001), and HSGPA .403 (p < .001) producing an explained variance of .394 
(Table 2). 



Table 2: Model Two Explaining Persistence with a Cumulative GPA of 3.2 



2 R 2 CumGPA 3.2 
N=366 



Primary Significant Total Effects on R 2 
Return - Persistence Total Effects 
Reduced R Square = 0.394 



6 Endogenous 
6 Exogenous 

*p< .01 **p< .005 



Goal Clarity 


0.084* 


Quality of Effort 


0.111** 


TSATMV 


0.296*** 


HSGPA 


0.403*** 


***D < .001 





Effects are mostly 
Indirect 
Direct 
Direct 
Direct 



Goodness of Fit: Chi-Square with 48 degrees of freedom = 25.625 (p = .996). 
Goodness of Fit Index (GFI) = 0.996 Adjusted Goodness of Fit Index (AGFI) = 0.993. 
Root Mean Square Residual (RMR) = 0.0326. (Joreskog and Sorbom, 1993 ). 



Discussion: 

Two principal structural equation models were chosen to examine the differences observed in the explained 
variance of key endogenous variables and in particular for Persistence/Returned Fall 2 with a Cumulative GPA of 
2.5 and 3.2 respectively. Each model produced close to a "perfect fit" as "Goodness of Fit" statistics indicate 
between the paths explored and the empirical data modeled (Table 1 and 2). 

Twenty-three (23) total effect variable paths are included in the model explaining persistence with a GPA of 3.2, 
whereas twenty-one (21) total effect variable paths are found in the model explaining persistence with a GPA of 
2.5 with effects < .08 trimmed in each model. Upon comparing structural models, the two models differ 
principally with respect to the addition of one endogenous path on Perceived Support from Quality of Effort 
(0.556, p. <.001) in the model explaining persistence with a 2.5 GPA, in fall 2007 plus one net additional 
exogenous variable path. In comparison, the total effect of Goal Clarity on Quality of Effort in the model 
explaining students' return/persistence with a 3.2 GPA was 31 percent or .180 standardized units larger than the 
alternate model, thus producing a more efficient outcome. 

The fitted models, chi square values, and measurement error differ for the respective models. The model 
explaining persistence or return with a GPA of 3.2 has a better overall structural fit with a lower chi square value 
and higher probability. The level of explained variance for the criterion variable persistence/return is higher with 
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less total measurement error in the model explaining persistence with a 3.2 GPA. Despite this comparative 
distinction, both models explain persistence very well. 



Interestingly in both models the TSATMV and HSGSPA bear the strongest effects on persistence at low to 
moderate levels adding to the debate about the SAT and the use of alternate indicators like HSGPA and rubric 
scores as a means to predict persistence. While the effect of the SAT and HSGGA were not among the primary 
purposes of this research inquiry, its presence in the structural model as a background or exogenous variable 
brings some interesting considerations with respect to the current debate concerning admissions testing, versus 
other indicators for making college admissions decisions, particularly with regard to the variance explained of 
Persistence at the two levels of Cumulative GPA used at 2.5 and 3.2. Effects like these provide fuel for debate 
about the appropriate use of the SAT in admissions decisions that have embroiled academe for some time. 

While the debate is a most important one, the author refers readers to the literature and recent articles by Linn 
(2009) and Atkinson and Geiser (2009) so that the findings regarding the ePortfolios and evaluative rubrics used 
can be more centrally explored. This tact regarding the discussion of the results in no way diminishes the value of 
controlling for the SAT and/or exploring the effects of the SAT and HSGPA accordingly, or for that matter, 
exploring the subject of the SAT in higher education that examples like this research can help elucidate. 



Conclusions: 

As a possible explanation, students returning with a GPA of 2.5 may perceive greater support as a result of the 
quality of effort achieved. That is, these students may not be able to convert the support experienced as 
effectively into a persistence outcome, as compared to students returning with a 3.2 GPA. Tracing the effects in 
the structural path model is difficult to conclusively assert, but remains a possibility for further consideration. 

More importantly, students in the first model persist with a lower level of explained variance due to the relative 
effects of the SAT and HSGPA on the Persistence between models. Interestingly, the endogenous model variables 
of goal clarity and quality of effort have a stronger impact in the model explaining persistence with a GPA of 2.5, 
giving Freshman Studies mentors a diagnostic tool for assessing and supporting student persistence behavior with 
GPAs at or below 2.5 with greater insight. A question remains though, if students with stronger effects of goal 
clarity and quality of effort are persisting at lower levels of explained variance with lower Cumulative GPAs, why 
may this be the case? Accordingly as the exogenous effects from both models indicate, the effects of the SAT and 
HSGPA, as background variables, determine stronger persistence outcomes for students persisting with 3.2 
Cumulative GPAs, that is, higher levels of explained variance are evident for students persisting with higher 
Cumulative GPAs. Freshman Studies mentors can plausibly use evaluative rubrics diagnostically with a Registrar 
based alert system composed of GPA and other critical data, indicating the heightened possibility of withdrawal 
concerning students with these potential characteristics. 

Linking electronic portfolios (Yancey 2008) and persistence models (Cabrera, Nora, and Castaneda, 1993; Sandler 
2000) is new to higher education research bringing greater insight and refinement to key issues and underlying 
student beliefs. Assessment using rubrics based on theories and models in the persistence literature provide 
important quantitative measures such that practitioners and counselors can take steps to stem attrition using 
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electronic portfolios as a source of persistence data (Sandler, Fisher, and Zedeck (2008); Sandler 2008; Wankel, 
Gottlieb, and Easterling, 2008). 

Carefully designed interventions geared to assist students to continue their studies are better equipped to help 
freshman focus on instrumental goals and a purposeful sense of self-efficacy to undergird their academic and 
career pursuits (Sandler 2000; Phan 2009b). This is a particularly important process that at-risk students and 
lower academically prepared learners need to acquire and practice (Friedlander, Reid, Shupak, and Cribbie, 2007) 
considering the support they receive from friends and family (Cabrera, Nora, and Castaneda, 1993; Sandler 2000). 

By strengthening Freshman Studies co-curriculum and core initiatives with ePorftfolios that have an impact on 
student learning effectiveness using technology (Landry and Stewart, 2005), the institution has taken measureable 
steps to promote the adjustment, success and persistence of first year college students returning in the fall term 
of their second year (Chickering and Kuh, 2005; Sandler 2000; Wankel, Gottlieb, and Easterling, 2008), much in the 
same way the seven principles of good practice of Chickering and Gamson (1987) can affirm the benefits that an 
enriched "active learning" curriculum can have on at-risk and lower academically prepared students adjusting to 
the demands of college in the classroom during the first year (Braxton, Jones, Hirschy and Hartley, 2008). 
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A Review of Freshman ePortf olios Using Persistence Rubrics 



Fall 2006 ePortfolio Requirements 



Required Elements 

• Welcome 

• Academics 

• Activities 

• Poetry Reflection 

• COMPASS 
Events 

• Career Goals 

• Community 
Service 

• My Thoughts 



jJt 



Welcome Page 
Academics 
Activities 
Poetry Reflection 
COMPASS 
Career Goals 
Community Service 
My Thoughts 
Blog 

Photo Album 



Additional Elements* 

• Reflection on 
Ethics or Computer 
Skills 

• Photo Album 

• Blog/MySpace 

• Resume 

• Art Work, Music or 
Multimedia of Own 
Creation 

• Students must choose 2 



Wednesday - July 23, 2008 



DiPA«Tiia«T or mro«MATio« iicmnoioo* 



SI ION AAA 
IIM I ■■■ 
tlNIVT KM IV 




A Review of Freshmen ePonfoiios Using Persistence Rubrics 



Emphasized the use 
ePortfolio as an opportunity to 
evaluate first semester 
through reflection 

Technical support came from 
mentors and peer advisors 

Checkpoint Assignments due 
throughout semester 



(Sandler, Easterling, and Zedeck, 2008; Sandler 2008) 
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A Review of Freshman ePortfolios Using Persistence Rubrics 




Activities 

What activities have you been involved in, on or off campus, that 
have enhanced your first year of college? Describe in 200 words 
or more and include images and web resources where 
appropriate. (Due Week 1 0) 



Career Goals 

Where do you see yourself after graduation? What career paths 
interest you? How you are going about exploring these differing 
areas... Describe in 200 words or more, include images and web 
resources where appropriate. (Due Week 13) 



jJt 



otr*«tut«T or m»o«MATio« lacMnoioo* 



Wednesday- July 23, 2008 



SKIONAAA 

mm i mm 

UNI VI RSI n 



A Review of Freshman ePortfolios Using Persistence Rubrics 



Student Profiles 

Entering Major Other Undec Dip Bio Com Pol 



jJt 




Wednesday - July 23, 2008 



SKI ON Ail 

hai i mm 

I INI VI KSI IV 



(Sandler, Easterling, and Zedeck, 2008; Sandler 2008) 
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A Review of Freshmen ePonfoiios Using PerssrenceRubncs 



66 



Pillars of Retention” 



\ 



Prepared 

Academically 

Financially 




Engaged 

Academically 

Integrated 

Socially (campus) 




dJt 



sfton 
ii a i i Bin 



A Review of Freshman ePortf olios Using Persistence Rubrics 




Seton Hall Students and Family 



• 77% live with both parents 

• Most live within 50 miles or less 

• 50% parents with a college degree 

• 9% English as a second language 

• 20% expect to live at home 

• Family plays important role in college selection 




“Support from my family has made the biggest 
difference in the world. When I came to SHU, it was like 
we all received a letter of acceptance.” 



-Student, Communications Major ‘09 



Wednesday- July 23, 2008 



SKIOKAAA 

mai I BUB 

UNI VI RSI I Y 



(Sandler, Easterling, and Zedeck, 2008; Sandler 2008) 
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A Review of Freshman ePortf olios Using Persistence Rubrics 



SHU’s ePortfolio Study: Research Qs 

Can ePorts serve as a source of information 
concerning first year student experience? 

What can be learned from a systematic review 
of freshman ePorts? Will rubrics based on 
persistence theory produce meaningful data? 



Will ePort data increase our ability to predict 
student persistence from first to second year? 



dak 



Wednesday - July 23, 2008 






U ION J 
MAI. Lr__ . 
MNivlksirv 



A Review of Freshman ePortf olios Using Persistence Rubrics 



SHU’s ePortfolio Study: Project Design 

Review 2006 freshman ePorts -> create scores 

• non-cognitive data: student experiences & thoughts 

• examine quality of effort: how well ePort was constructed 

Score e-Ports, measure levels of key attributes 

• known to associate with persistence and 

• present in the freshman 2006 ePortfolios 

Key Attributes 





Vgoal clarity 


v academic engagement 








v quality of effort 


V support of family & friends 








v social integration 








dak. 




Wednesday- 


H|jy23, 2008 ■ 


M l ON A A A, 

hallHM 

IINIVI RSI IV 



(Sandler, Easterling, and Zedeck, 2008; Sandler 2008) 
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A Review of Freshman ePonfbfj as Using Pecs seen ce Rubies 

5 Rubrics — holistic & analytical approach 

Goal Clarity Rubric - (Academic and Career Goals) 

4 -Mature focus of academic and career coals, enterprising and realistic 
3 - Clear expression of academic and career goals 

2 - Elements of career exploration, some sense of career goals or academic goals 

1 - tack of focus or clarity of purpose expressed about college (academic and/or career goals), 
goal uncertainty 



(Sandler, Easterling, and Zedeck, 2008; Sandler 2008) 
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SHU Integration & Engagement Rubric 

Contact Janet Easterling easteriaSjshu.edu 




Social In te 


cration ePortfolio Measure 








Category 








4 - Leadership Role 


3 - Much Integration 


2 - Some Integration 


1 - Scant/No Evid Social 
Integration 






Much Integration (as inscribed 
foitcortj') 

PLUS 

either in a leadership role at 
SetonHall or expresses interest 
m a leadership role next 
term, next year 

examples: position in FLO. 
SGA. SAB. SHU team or dub 


Regular and or Intensive 
involvement m 2 or more SHU 
activities, dubs or groups. 

•e.g., high frequency 
•e.g., strong identity potential 

examples: SHU team, 

SHU intramural or 
high involvement SHU club 


At least 1 student-selected 
SHU activity or experience 
involving regular (at least 
monthly) participation that is 
viewed positively by student 
•e.g., described as 
pleasing engaging of value 
OR 

ALTERNATIVELY 
expresses a dear intent to 
participate next term next year 


Student shares none or few 
instances of SHU activities , 
dubs or group partidpation 
levels bevond assigned. 

AND 

no statements suggesting intent 
to join an activity, dub or 
group in the near future. 




Academic Encasement ePortfolio Measure 










Category- 








4 - Engagement + 
Challenge 


3 - Much Academic 
Engagement 


2 - Some Academic 
Engagement 


1 - Scant/No Evid Acad 
Engagement 






Much Engagement is described 
for score 3’) 

PLUS 

evidence that at SHU this 
student is experiencing a good 
level of (positive) academic 
challenge 


2 or more SHU professors/ 
courses portrayed as a definite 
positive experience - ie, as 
enjoyable, engaging or of high 
quality 

• e.g., 2 or more courses 

portrayed this way 
•e.g., description includes 
these attributes as an 
overall for courses, major 
program, or intended major 


At lean 1 course or professor 
described as a definite positive 
experience for this student 
• e.g., enjoyable, engaging 
student’s interest, or very 
meaningful or of value to 
student pers onally 
OR statement of being helped 
or supported academically 
well by SHU course or 
resource 


Student indudes no 
descriptions of positive 
experiences of a course or 
professor 

ie, characterized as stimulating, 
interesting or of particular 
value 

AND no mention of SHU 

academic supports as helpful 
resources 















(Sandler, Easterling, and Zedeck, 2008; Sandler 2008) 
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